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I. INTRODUCTION 

The Maximum Entropy (MaxEnt) formalism provides 
an alternative to more conventional statistical mechanics 
approaches by offering a convenient jumping off point for 
thinking about problems that are not within the purview 
of equilibrium statistical mechanics. For non-equilibrium 
systems, the corresponding idea is called the Principle of 
Maximum Caliber (MaxCal), in which we attempt to de- 
termine the probability that a particle travels on a partic- 
ular space-time path rather than its probability of occu- 
pying a certain energy level [7]. One way to think about 
these information-theoretic approaches is that the proba- 
bility distributions generated by MaxEnt and MaxCal are 
the least-biased inferences about the distributions that 
can be made on the limited information that is in hand; 
i.e., by maximizing the Shannon entropy over the collec- 
tion of possible outcomes for the system of interest [TS] . 
MaxEnt has been used for several decades to model ev- 
erything from neural firing [13] to climate change (TO) and 
many applications between. MaxCal has been subjected 
to a few applications including analysis of the dynamics 
of a two-state system [16j [17] and to examine the origin 
of phenomenological transport laws including Fick's law 
of diffusion [T3] and fluctuation theorems [I]. 

The MaxCal approach is relatively unexplored and has 
been set forth as a very general method of analyzing 
nonequilibrium systems [7HS]. By applying MaxCal to 
experimentally realizable systems, we hope that we can 



not only make useful predictions of the behavior of con- 
crete experimental systems, but also help identify and 
highlight the outstanding theoretical questions that im- 
pede progress towards practical use of MaxCal. One such 
system that we find appealing is the dynamics of a two- 
state system, partly because of its simplicity and because 
of the opportunity to manipulate such systems experi- 
mentally. To that end, in this paper, we analyze the 
dynamics of a two-state system, cognizant that it is only 
one concrete application of the MaxCal approach and 
that much remains to be done to demonstrate MaxCal's 
usefulness more generally. 

MaxEnt as used in equilibrium statistical mechanics 
and MaxCal exploit almost entirely the same theoretical 
prescription, except that MaxEnt as used in equilibrium 
statistical mechanics identifies the entropy-maximizing 
probability distribution of particle occupancy over energy 
states, whereas MaxCal identifies the ca/i&er-maximizing 
probability distribution of particle occupancy over pos- 
sible space-time paths ("microtrajectories"). Caliber is 
an entropy-like quantity that has the same form as the 
Shannon entropy, C = X^rPr hipr + J2i ^i(Ai)r- In this 
equation, C is the caliber, pr denotes the probability of 
a given microtrajectory T, and each (Ai)r is a macro- 
scopic observable which serves as a constraint within the 
information-theoretic approach. For convenience, we will 
denote an average over the microstates (A;)r as (At). 
The constants Aj are Lagrange multipliers corresponding 
to those constraints. Maximizing the caliber yields a full 
probability distribution for all the allowed microtrajec- 
tories. 
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In this paper, we analyze the dynamics of the two- 
state system using a MaxCal model and derive new in- 
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sights into MaxCal and the discretized two-state system 
in the process. The organization of this paper is as fol- 
lows. Background on MaxCal is presented in Section [Tl] 
In Section |TTl} we show that the dynamics of a two-state 
system are mathematically equivalent to the 1-D Ising 
model, and that there are different but equivalent ways 
of picking the MaxCal constraints. In Section |IV| we 
use simulation to investigate the relationship between the 
MaxCal model for the two-state system proposed here 
and a previously proposed MaxCal model for the two- 
state system [TBI HI] • 

II. BACKGROUND 

As noted above, caliber is an entropy-like quantity that 
increases as the relative probabilities of the microtrajec- 
tories becomes less predictable. As a result of maximizing 
the caliber, MaxCal asserts that our best guess as to the 
probability of observing a particular microtrajectory T is 

Pr = g cxp(^ XiA,r), (1) 

i 

where 

Z = E cx p(E A ' A ^ (2) 

is a normalization factor dubbed by Jaynes as the "par- 
tition functional" and the A^r are values of macroscopic 
observables Aj along the microtrajectory labeled T. Aj 
are the corresponding Lagrange multipliers that can be 
calculated from (A.,) = [7]. 

A distinguishing feature of MaxCal-derived formulas 
of nonequilibrium statistical mechanics as compared to 
more conventional nonequilibrium statistical mechanics 
formulas, e.g. the Jarzynski equality j6], is that MaxCal 
solves an inverse problem, in which we infer microscopic 
properties based on macroscopic observations. The Max- 
Cal distribution described in Equation [l] is typically gen- 
crated on the basis of knowing only a small number of 
macroscopic observables (Aj) and predicts the probabil- 
ity of traveling any one of the many possible microtrajec- 
tories T. For example, in the two-state systems simulated 
in this paper which each have 10 5 time steps, only two 
macroscopic observables are used to generate predictions 
for the probability of traversing the entirety of the 2 10 
possible microtrajectories. However, since the average 
probability of observing a particular microtrajectory is 
typically very small, it is difficult to obtain accurate ex- 
perimental estimates of pr itself to which we can compare 
MaxCal predictions. Instead, to test the accuracy of a 
MaxCal model, we can predict higher order moments of 
the joint probability distribution p( A\ , A2 , . . . , A„ ) . These 
higher moments are more robust than individual micro- 
trajectory probabilities pr to the depth of our experimen- 
tal investigation of the system. Again, note that these 



higher moments are not used in any way to determine the 
probability distribution p{A±, A„) itself. Rather, they 
are predictions about more nuanced features of the two- 
state system than those simple average quantities used 
to establish the distribution given in Equation [l] 

III. STATISTICAL DYNAMICS OF THE 
TWO-STATE SYSTEM USING CALIBER 

The dynamics of the two-state system can be com- 
pletely characterized by rate equations in terms of the 
constants Ua and fcs, where kA and fcs are the intrin- 
sic rate constants for transition from state A to state B 
and vice versa [2]. Indeed, one of the interesting out- 
comes of the present paper is a simple relation between 
the conventional rate constants and the Lagrange multi- 
pliers that are central to the MaxCal description of the 
same system. 

To make the dynamics of the two-state system 
amenable to simple MaxCal analysis, let the MaxCal tra- 
jectory F be a string of l's and — l's describing the state of 
the system as a function of time. More explicitly, suppose 
that our two-state system is a particle jumping between 
wells on a double-well potential energy landscape, exam- 
ples of which are shown in Figure [l] Let or(t) represent 
the system's state at time t. If the particle is in the left 
potential well at time t, then we say it is in state A and 
that <rr(t) = 1; if the particle is in the right potential well 
at time t, then we say it is in state B and cr-p(t) = — 1. 
Thus, a particle's trajectory T is equivalent to a series of 
A l's and —l's, for which the particle's state is sampled 
every At and the total time spent observing the particles 
of interest is A At. 

This discretized picture of the two-state process will 
lead to accurate calculations only if our time step At is 
small enough to capture nearly all state transitions 0]. 
In other words, in the language of rate constants, we re- 
quire that the average waiting time in both states is much 
larger than the time step At. For Markov systems, the 
waiting time in a particular state t follows an exponential 
distribution with a mean of (t) = I 2J. Thus, here, we 
require At << or identically fc^At, fc#At << 1 

as described previously [T7] . If this heuristic condition is 
satisfied, missed transitions are negligible. For the two- 
well potential landscapes considered here, waiting times 
range from 0.5 to 5 s, whereas At = 1 ms. 

A. The dynamics of the two-state system is 
equivalent to the one-dimensional Ising model 

There are many different ways that one can imagine 
characterizing the trajectories realized by the two-state 
system as it sweeps out a telegraph signal [2 . The partic- 
ular choice that is made has implications in turn for the 
nature of the MaxCal constraints used to describe the 
system. However, it is still unclear to us what general 
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the partition functional takes the simple form 



(A) 



(B) 





FIG. 1: Representative simulated trajectories on two 
different two-well potential energy landscapes. A sim- 
ulation of a particle diffusing on a double Gaussian poten- 
tial surface generates trajectories of the particle diffusing on 
the energy landscape according to Equation ( 26 1. The traces 
show the raw data. States are assigned after boxcar filtering 
and threshold finding. (A) Potential well number f . See Ta- 
ble [IT] The state of lower potential energy is more frequently 
populated; there is a high barrier, with infrequent transitions. 
(B) Potential well number 8. See Table [TTJ The upper and 
lower states are populated roughly equally. 



criteria must be used when choosing constraints (Ai) for 
some specific new problem. 

For the two-state system considered here, we focus on 
two distinct constraints: the average number of times 
that the particle switches states over the course of a mi- 
crotrajectory ((N s )), and the "aggregate state" of the 
particle ((«)). We define the aggregate state mathemat- 
ically using the stat e variable cr(i), which was defined 
earlier in Section 



Iff 



as ir 



x &r(t), so that 



JY 



=EME^(*) 



(3) 



where we obtain the average by summing over all the pos- 
sible microtrajectories of the system (labeled by T), each 
weighted by its probability pr- Intuitively, the "average 
state" of the particle (-^-) corresponds to a measure of 
where the particle is most frequently found. If the par- 
ticle is frequently found in state A, then (i) ~ N; if the 
particle is frequently found in state B, then (i) ~ — N; 
and if the particle spends its time equally between the 
two states, then (i) ~ 0. In terms of experimental quanti- 
ties, the average state is analogous to the average current 
if we think of the telegraph signal as the current passing 
through an ion channel in a single-channel measurement 

With these two constraints and the MaxCal formalism 
described above, we find that the discretized version of 



Z = exp(aN s> r + Mr), 



(4) 



where a and h are the Lagrange multipliers associated 
with our two constraints. The probability of observing a 
particular microtrajectory is accordingly 



Pr = g cxp(aN S: r + Mr)- 



(5) 



More precisely, this expression provides the probability of 
observing a particular microtrajectory T with aggregate 
state ir and number of switches N Si r, where the subscript 
T labels the trajectory of interest. 

To cast this expression in a more useful way, we notice 
that (N s ) can be expressed in terms of ar(t) using the 
quantity ( °T(*+i)-gr(t) ^ w hi c h compares the state of 
the system at two subsequent instants in time and is 1 
when the particle switches states and otherwise. Then, 

(N a ) = ErPr(E t r r(t+ *2~ Jr(t) ) 2 ) and from combining 
this fact with Equation [3j Equation [4] can be rewritten 



(JV-i)At 



Z = 



5>xp(- IN- J2 °r(t + At)ar(t) 
r y t=At 

NAt 

+h Mt)) (6) 

t=Ai 

(JV-X)Ai 

ex p(f 7V )E ex P(-f E of(* + At)or(t) 
r t=At 

NAt 

+h «7f(t)). (7) 



t=At 



Let J 



Then 



Z = exp(-JN)^2exp(J^2ar(t)ar(t+At)+h^2a r (t)). 
r t t 

The partition function in Equation [8] looks like the par- 
tition function for the 1-D Ising model. In this context, 
a spin at position x corresponds to the particle's state 
at time t] the lattice spacing Ax corresponds to the time 
step At; h is analogous to the applied magnetic field; and 
J is the analog of the coupling constant between spins. 
In the Ising model, the magnetic field drives spins to pre- 
fer one direction over another and the coupling constant 
drives neighboring spins to align. In the two-state sys- 
tem analogy considered here, the "magnetic field" drives 
the particle to favor one of the two potential wells, and 
the "coupling constant" recognizes that particle's state 
at time t + At depends on its state at time t and thus is 
responsible for the temporal correlations of the system. 
This analogy will be discussed further in Section |III B| 

The most convenient scheme for determining the par- 
tition function in Equation [8] analytically is to exploit 
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periodic boundary conditions. Though it is natural in 
the context of spins to talk about periodic boundary con- 
ditions, such conditions in our dynamical problem corre- 
spond nonsensically to time running in circles. Neverthe- 
less, the mathematical convenience of periodic boundary 
conditions makes them an attractive mathematical op- 
tion. (The errors incurred in making this simplifying as- 
sumption are discussed later.) Under the assumption of 
periodic boundary conditions, the 1-D Ising model parti- 
tion function can be evaluated analytically using transfer 
matrices as Z = e~ JN (\+ + X^) where A + and A_ are 



the eigenvalues of the transfer matrix T — i _j _ h+J 

As usual in maximum entropy problems, the values of 
the Lagrange multipliers are found by evaluating partial 
derivatives of Z |T. In particular, we need 



d\nZ 
dh 



(i) 



(9) 



the sum of the number of times it switches from state A 
to state B and vice versa, 



N s .t = N ab , r + N ba>r . 



(13) 



Additionally, the average state of the particle is the 
weighted sum of the amount of time it spends in state 
A and the amount of time it spends in state B, 

*r = (1) (N aa , r + AW) + (-1) (N bbX + A^r) ■ (14) 

Under the assumption of periodic boundary conditions 
used to calculate the partition function in Section [ill A| 
the particle must start and end in the same state, and 
therefore switch from state B to state A just as many 
times as it switches from state A to state B resulting in 
the constraint 



N ab r = N ba r. 



(15) 



and 



The Equations T2p5 above allow us to solve for the N xy 
quantities in terms of N s and i, namely, 



dlnZ dlnZda 



dJ 



da dJ 



= -2(N S 



(10) 



Equations |9| and [l0| are transcendental and can be solved 
numerically. 



N, 



N + i r - N s 



aa,T 



N bbS = 



N-i T - N 



s,r 



(16) 



(17) 



B. 



Relation to MaxCal partition functional with 
Markov constraints 



Even though Equations [9] and 10 are transcendental, 
we can find closed-form expressions for h and J in terms 
of the rate constants Ua, &b, and the time step At by re- 
lating a previously used two-state MaxCal partition func- 
tional to the one used here. In an earlier MaxCal analysis 
of the two-state system, the constraints N aa , N ab , N ba , 
and N bb were used instead of N s and i [IB] [T7]. The 
quantity N xy reports the number of time instants of 
length At out of a total of iV such time steps where the 
particle moved from state x to state y. The MaxCal par- 
tition function using this alternative set of constraints 
is 



N„ 



N, 



'Yab ^ba 



,,r N bb r 

%b . 



(ii) 



where each T is a different microtrajectory. 

Note that the four constraints (N aa ), (N ab ), (N ba ), 
and (N b b) are not linearly independent, since the particle 
can only start in state A or B and move to state A or B 
in each of the ./V time steps. This constraint is captured 
by the relation 



and 



N, 



b,r — NbaT 



(18) 



If we substitute Equations [T6j [T7j and [18] into Equation 
|TTJ we find that 



7 ~,Naa r N°-t>,r N ha .,r N bb , T 

Z = 2^ 7 «° %b %a %b 

r 

, N \ll(j aa -f bb ) ^ Mlaa,. AT v 

= exp( ) x 2^exp(— — (» r - 7V s , r ) 



(19) 



-^r + N sx) + l ^^N sX ) (20) 
= eM NHlaalbb) ) x 

E,ir , ,laa, N sF , ,lablba,, /01 s 

exp(— ln( ) + — -ln( )). (21) 

r 2 7 6b 2 laalbb 

Therefore, the probability of the particle moving along a 
particular microtrajectory T is 



Pr 



ex P (fln(^) + f ln(%%)) 
Er/ exp(^ln(^) + ^ln(^)) 



(22) 



A^r = N a 



N 



b.r 



+ N ba r + N bb r- 



(12) 



To relate these constraints to N s r and i?, note that the 
total number of times that the particle switches states is 



To recapitulate, we have two different MaxCal formu- 
lations of the two-state system dynamics, derived from 
two apparently different sets of constraints. Their par- 
tition functions are given by Equation [4] and Equation 
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21 Both models accurately describe the two-state sys- 
tem, as shown in Section IV and Reference 1171. We can 



impose the consistency condition that both models have 
the same predictions for pr, and hence they must have 
the same Lagrange multiplier coefficients for iV Si r and ir- 
As a result, we can prescribe the equivalence of the two 
formulations through the relations 



and 



2 J = -ln( ) 

2 7aa7bb 



h = \H—)- 

2 Jbb 



(23) 



(24) 



Recall that these Lagrange multipliers are [T7] 
k A At, 7 6a = k B At, 7 ao 



lab 



l-k A At, 7b6 = 1-fcuAt. 

These statistical weights are Markovian in nature: 7 a 6 is 
the probability that the particle will transition from state 
A to state B in the time interval At, jba is the probability 
that the particle will transition from state B to state A 
in the time interval At, and so on. The alternative inter- 



pretation is that according to Equation 23 the "coupling 
constant" increases as dwell times increase; Equation [24] 
suggests that the "magnetic field" increases as state A is 
favored over state B and vice versa. 

Note that the calculations in [T7] used exact bound- 
ary conditions, whereas Equation [8] exploited the ana- 
lytic convenience of periodic boundary conditions. As a 
result, any differences between the predictions of the two 
MaxCal partition functionals is an inheritance of the dif- 
ference in boundary conditions. In this way, we can mea- 
sure to what extent potentially false assumptions about 
boundary conditions will affect the validity of moment 
predictions. As we will see later, the particular choice of 
boundary conditions are practically irrelevant for the sys- 
tems considered here because the particles are observed 
for many time steps. 



IV. TESTING THE MAXCAL MODEL VIA 
NUMERICAL SIMULATION 

We wish to test our MaxCal model by comparing the- 
oretical predictions to data obtained from simulations or 
experimental measurements of a two-state system. In an 
earlier paper, we described the use of a dual-well opti- 
cal trap that could be used to sculpt different two-state 
trajectories by tuning the properties of the adjacent wells 
[17j . In this paper, we continue along similar lines, but in- 
stead using simulated data for this system like that shown 
in Figure [T] Trajectories were simulated according to the 
Langevin equation subject to an external potential [3J, 



dV(t) 
dt 



M 



V(t) 



dU 
dx 



M 



T(t) (26) 



where U{x) is a potential of the form 

(x 



U(x) = -E x exp(- 



E 2 exp(- 



(27) 

meant to mimic the two-well landscape imposed by the 
optical traps. The parameters fj,\ and fi2 give the x- 
coordinates on which each well is centered; the parame- 
ters (Ti and CT2 refer to the width of each potential well; 
and Ei and E2 refer to the depth of each well. In sim- 
ulations, parameters fj.%, /12, 01, and 02 were kept con- 
stant. However, fifteen different combinations of E\ and 
£2 were used to simulate fifteen different double poten- 
tial wells. See Table [I] and Tabic |H| for a listing of E\, 
E2, and AE = E\ — E2 for each of the relevant energy 
landscapes. 



Parameter 


Value 


Mi 


-270 nm 


/'2 


270 nm 


o\ 


200 nm 




200 nm 


m 


0.55 pg 



TABLE I: Parameters governing the geometry of the potential 
wells for the dynamics simulation, fii refers to the center of 
the i th well and at is the RMS width of the potential. The 
width and mean position of the well were the same for all 
simulated potential surfaces, m is the mass of the particle. 



Potential AE £1 E 2 
Well# (k B T) (k B T) (k B T) 



1 


-2.5841 


1 


9009 


4 


4851 


2 


-2.2803 


2 


0607 


4 


3409 


3 


-1.9764 


2 


2243 


4 


2007 


4 


-1.6724 


2 


3918 


4 


0642 


5 


-1.3684 


2 


5629 


3 


9313 


6 


-1.0643 


2 


7375 


3 


8019 


7 


-0.7602 


2 


9156 


3 


6758 


8 


-0.4562 


3 


0969 


3 


5531 


9 


-0.1521 


3 


2814 


3 


4335 


10 


0.1521 


3 


4690 


3 


3169 


11 


0.4562 


3 


6595 


3 


2034 


12 


0.7603 


3 


8529 


3 


0927 


13 


1.0643 


4 


0492 


2 


9848 


14 


1.3684 


4 


2481 


2 


8797 


15 


1.6724 


4 


4496 


2 


7772 



TABLE II: Parameters governing the depths of the potential 
wells for the different simulations. The relative depth of the 
two wells varied between each simulated potential surface. 

The simulations give us explicit realizations of the tra- 
jectory distribution that we can compare to theoretical 
predictions of our MaxCal model via partial derivatives 
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FIG. 2: Comparison between the value of the vari- 
ance of i obtained analytically and the variance ob- 
tained by "measuring" the properties of simulated 
trajectories. The graph shows the variance for each of 
the simulated potential surfaces characterized in Table [TT] 
with each data point corresponding to a particular poten- 
tial well. The MaxCal results are shown for the cases when 
periodic boundary conditions and exact boundary conditions 
are used. The best fit line to the periodic boundary condi- 
tion data is y = 1.034a; - 2.5 x 1CT 4 with an R 2 = 0.9945; 
the best fit line to the exact boundary condition data is 
y = 0.9724a; - 5.8 x 10~ 5 with an R 2 = 0.9923. 



FIG. 3: Comparison between computed and simulated 
statistical correlations. The graph shows the statisti- 
cal quantity labeled above the graph for each of the simu- 
lated potential surfaces characterized in Table [TTJ with each 
data point corresponding to a particular potential well. The 
MaxCal results are shown for the cases when periodic bound- 
ary conditions and exact boundary conditions are used. The 
best fit line to the periodic boundary condition data is y = 
1.0063a;- 1.5 x 10~ 7 with an R 2 = 0.9957; the best fit line to 
the exact boundary condition data is y = 0.9625a: — 1.2 x 10~ 7 
with an R 2 = 0.9955. 



of the partition function. For example, we can compute 
the fluctuations in the mean state as 



d 2 InZ 
dh 2 



1 d 2 Z 

zlm 2 



,d\nZ, 2 



(28) 



^Pr(y> r (t)) 2 -W 2 (29) 



r 



(* 2 ) - U) 2 . 



(30) 



Similarly, we can compute other correlation functions of 
interest such as 



d 2 InZ 
dJdh 



= -2((N s i)-(N s )(i)) 



and 



d 2 InZ 



= 4((7V 2 ) - (N s ) 2 ). 



(31) 



(32) 



To test our MaxCal model, we compared moments 
computed from the simulated data described previously 
with moments predicted by the MaxCal model as re- 
vealed in Equations 30 [31] and 32 for example. Figures 
[2j [3j and [4] demonstrate good agreement between simu- 
lated data and the moments predicted from the MaxCal 
model via Equations [30] [3TJ and [32] respectively. The 
calculations from this MaxCal model are also compared 
to the calcula tions from the MaxCal model described in 
Section llTTBl [13 



In these graphs, each data point corre- 
sponds to a different potential well setup and error bars 



correspond to standard error. Uncertainty in calculated 
values of moments stems from uncertainty in the value of 
the constraints taken from simulated data. See Appendix 
I for details. 

From Figures [2]4j there is good agreement between 
the two MaxCal models, which we have already argued 
are equivalent aside from a difference in boundary condi- 
tions. This difference between the moment predictions in 
Figures 2]4 is barely perceptible because N — 10 5 >> 1, 
but there is certainly a significant difference in MaxCal 
predictions due to boundary conditions when there are 
very few timesteps [T6]. For most cases of interest, the 
long-time limit will be the relevant situation in which 
the boundary conditions become less relevant as the to- 
tal sampling time N At increases compared to the time 
step At, just as surface terms become irrelevant in the 
thermodynamic limit in equilibrium statistical mechanics 

nu. 

This indifference to boundary conditions can also be 
seen by testing Equations [23| and [24] derived for La- 
grange multipliers in Section |III B| Recall that those 
equations hold only if periodic boundary conditions and 
exact boundary conditions lead to equivalent results, and 
therefore any deviation from the equations is due en- 
tirely to a difference in boundary conditions. Figures 
[5] and [6] demonstrate that Equations [23] and [24] agree well 
with the data from the fifteen different potential well se- 
tups described above, although Figure [5] shows a sys- 
tematic deviation due to a difference in boundary condi- 
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{(N S -{N S )) 2 ) 




3.95 



Simulation from exact boundary conditions 



FIG. 4: Comparison between the value of the variance 
of N s obtained analytically and the variance obtained 
by "measuring" the properties of simulated trajecto- 
ries. The graph shows the variance for each of the simulated 
potential surfaces characterized in Table [TTJ with each data 
point corresponding to a particular potential well. The Max- 
Cal results are shown for the cases of the partition functional 
used here (Equation[4| and of the Markov partition functional 
used in a previous analysis. The best fit line to the periodic 
boundary condition data is y = 0.9297a; + 2.9 x 10~ 10 with an 
R 2 = 0.9626; the best fit line to the exact boundary condition 



FIG. 5: The Lagrange multiplier J. Comparison be- 
tween predicted value of J from Equation ( 23 1 and its cal- 
culated value using MaxCal. The dashed line shows where 
the data points would fall if there were perfect agreement be- 
tween the two MaxCal models. The best fit line is given by 
y = 0.8944a; + 0.4134 with an R 2 = 0.9884. Deviations from 
the proposed relationships in Equations |23| and |24| can be as- 
cribed to the difference in boundary conditions, based on the 
analysis in Appendix II. 



data is y = 1.0342a; - 4.2 x 10 -11 with an iT 



0.9537. 



tions. We calculated rates Ha and ks from Equation [25] 
and the values of the Lagrange multipliers derived using 

wnrt = = = and 

d\-a-y b ~ (Nba)- See Appendix II for more details. 

The Ising model can also be used for predicting the 
autocorrelation function for the different states, so that 
MaxCal model calculations can be compared directly to 
predictions from the master equations for the two-state 
(i.e. random telegraph) problem [2]. In the language of 
the Ising model, the autocorrelation function for being in 
the state A is 



The quantity 



1 



)). (33) 



is 1 when the particle is in state A 



at time t and if the particle is in state B; thus, the 
quantity ( er ( t )+ 1 )( g '( t +J")+ 1 ) ac t s as a counter that is 1 
when the particle is in state A at times t and t + T, and 
otherwise. Expansion of this expression gives 

P(A,r) = \(l + 2^ + (a(t)a(t + r))). (34) 

Similarly, we can write the corresponding autocorrelation 
function for the other state as 

P{B,T) = \{l-2^ + {o(t)o{t + T))). (35) 




-0.5 
Predicted value of h x 10 3 

from exact boundary conditions 

FIG. 6: The Lagrange multiplier h. Comparison between 
predicted value of h from Equation (241 and its calculated 
values using MaxCal. The dashed line shows where the data 
points would fall if there were perfect agreement between the 
two MaxCal models. The best fit line is given by y = 0.9154a; 
with an R 2 = 0.9996. 



Here J, h are not time dependent, so that (a(t)a(t + t)) 
is the same for any t. We can evaluate (a(t)a(t + r)) by 
using standard transfer matrix techniques |llj . yielding 



the result 

(a(t)a(t + r)) = ^V(i)cr(t + r)p r 



1 



tr(D t {S- 1 PS)D T {S- 1 



Z 

PS)D N ~ t - T 



(36) 



(37) 



where T is given by Equation A ) and P is the Pauli 
spin matrix ( J _?i ) ■ We find that 



where 



x = 



s- 1 ps={ x *_ 1 -% 1 ) 

e 2J (e 2h - 1) 



y/4e 2h + e 4J (e 2 ' 1 - l) 2 ' 



(38) 



(39) 



Recall that D = ( A + A ° j , which makes exponentiation 
trivial, resulting in 



D" = 



Therefore, matrix multiplication gives 

e 4J (e 2 ' 1 - l) 2 



(40) 



(a(t)a(t + r)) - 



4 e 2/t _|_ 


e 4J (e 2h - 


I) 2 




4e 2h 




Ae 2h + 


e iJ (e 2h - 


I) 2 






— T 



(41) 



Xf + X N 

which we can use to directly calculate P(A, t) and 
P{B,t). 

A comparison between simulated and theoretical val- 
ues for P(A, t) is shown in Figure [7j Equations 34 and 
35 are quite accurate, although they are not identical to 
the probabilities that one would calculate using master 
equations. The reason for this is that our discrete Max- 
Cal model has a third implicit parameter in addition to 
}za and ks- At, the time scale associated with the dis- 
cretization of the trajectories. The exact nature of the 
dependence on At was made explicit in Section [ill B| 

There are benefits and drawbacks to using the MaxCal 
analysis presented here instead of a more traditional mas- 
ter equation analysis. For example, it is straightforward 
to calculate the joint probability distribution of N s and 
i, p(N s ,i), using the MaxCal model. Indeed, for some 
quantities we have not even been able to figure out how 
to compute them using the master equation treatment. 
The ease of these calculations in the MaxCal setting re- 
sults from the fact that the moments of the probability 
distribution p(N s , i) are simply partial derivatives of the 
partition function Z in our MaxCal model, and in the 
master equation formalism, one must calculate p(N s ,i) 
from P(A,t) and P(B,t). It is straightforward to calcu- 
late autocorrelations using the master equation formal- 
ism via a linear differential equation; the same quantity 
can be calculated from MaxCal using transfer matrices. 
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FIG. 7: Time dependence of the correlation function. 

The graph of Equation [34] is shown as a function of time in 
units of At for potential well number one. 



V. MAXWELL-LIKE RELATIONS FOR 
DYNAMIC PROCESSES 

Both in classical equilibrium thermodynamics and sta- 
tistical mechanics and in the thermodynamics of small 
departures from equilibrium, there are broad classes of re- 
lations such as the Maxwell relations and the Onsager re- 
lations that illustrate the mathematical linkage of quan- 
tities that at first blush might seem unrelated. In some 
cases, the simplest way to explain these relations is that 
they reflect equality of certain second-order mixed par- 
tial derivatives. The maximum caliber formalism admits 
similar relations [16] . In the language of trajectories, 
what these relations tell us is that if we have measured 
properties such as N s and i on one two- well landscape, we 
can predict what the dynamics will be like on a "nearby" 
landscape without doing any further measurements. 

In this MaxCal model, Maxwell-like relations fall out 
as the equality of mixed partial derivatives of In Z. For 
example, the statement that 9 g^gf — d a leads to 



d(N s 
dh 



Id 2 InZ 
2 dhdJ 



~ dJdh 

2 dJ ■ 



(42) 



Other results can be obtained from higher-order mixed 
partial derivatives, e.g. fj^f = gjg^i^j^) yields 

— \ 8 gfiT ~ — ■ -^ still remains to see how to turn 
such relations into general useful predictive tools for the 
design and interpretation of experiments. 



VI. CONCLUSION 

In summary, we have studied a single colloidal parti- 
cle undergoing a two-state process with stationary rates, 
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though the problem with time- varying rates is of great in- 
terest. This classic problem is studied using the theory of 
maximum caliber. By measuring relatively short trajec- 
tories (~ one hour), we are able to find the full probability 
distribution of trajectories from a MaxCal model using 
the average frequency of state-switching and the aver- 
age state as constraints, and confirm that the predicted 
trajectory distribution agrees with simulated data. Addi- 
tionally, we show that the "Markov-like" constraints used 
in an earlier MaxCal analysis of the two-state system [17] 
differs from the MaxCal analysis presented here only via 
a difference in boundary conditions. The mapping of the 
fsing-like MaxCal model onto the Markov-like MaxCal 
model allows us to assign a physical interpretation to the 
Lagrange multipliers. 

Mapping two-state dynamics onto a one-dimensional 
Ising model yields unexpected insights into two-state dy- 
namics, even though the master equations that describe 
two-state kinetics have been used for decades. First, we 
show that the dynamics of the two-state system can be 
mapped onto a 1-D Ising model whose "coupling con- 
stant" and "magnetic field" can be written explicitly in 
terms of fc^, fee, and At. Then we derive several relation- 
ships that hold true specifically for discretized two-state 



systems, i.e. the expressions depend on the time step 
At as well as the rates Ua and ks- We derive and ver- 
ify expressions for the moments of the joint probability 
distribution p(N s ,i), which to the best of our knowledge 
have not been derived previously using the traditional 
master equation formalism or anything else. Next we 
derive and verify an expression for the autocorrelation 
functions P(A,t) and P{B,t) in a discretized system. It 
is possible that these new formulas will be of practical 
value to those who study systems that can be modeled as 
two-state systems, e.g. ion channels and ligand-receptor 
complexes. 
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Appendix I 

Because of the finite time scale of our simulations, 
there is uncertainty in our simulation measurements of 
(i) and (N s ); there is a standard error associated with 
both measurements- (i) ± cr; and (N s ) ± o^, . Recall 
that the Lagrange multipliers J and h are determined 
by solving transcendental equations dX Qj Z — (2N S ) and 
dl Q h z = (i). These values must be modified in order to 
account for standard deviation ctjv 3 and cr, in our estima- 
tion of constraints (N s ) and (i). We can determine the 
standard deviation of Lagrange multipliers, erj and <Jh, 
by using error propagation on (i) and (N s ), namely, 



/ 5 (*> ^2 , Mi) v 3 



and 



2 ( 9{N S ) 2 d(N s/ _ ^ 2 



Oh 



dJ 



(43) 



(44) 
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The error bars in Figures [5] and 
tions from Equations [43] and [44 



Blare the standard deva- 



We can then use Equations ( 43 1 and (44 1 to solve for 
(j h and a j. Finding the standard deviation of second 
moments follows from a similar strategy in error prop- 
agation. For instance, X = (i 2 ) - (i) 2 = . The 
standard deviation of this quantity is 



' x 



,dX 



2„2 



,<9 3 lnZ, 2 2 ,<9 3 lnZ, 2 2 

C fll.il > a h + { ~ T ~,o ) Vj 



In this equation, 



dh 3 

d 3 InZ 
dh 3 



(45) 
(46) 



and 



d.Jdh 



dJdh 2 

z can be evaluated at 



J and h, and crj and oTj are obtained via Equations ( 43 ) 



and (44 1. Thus the standard deviation of (i ) — (i) can 



be evaluated. This analysis extends to the other second 
moments. Let Y = (NJ) - (N s ){i) = - \ %y d z and 

Z = (N 2 ) - (N s ) 2 = Similar analysis to that 

above shows: 



4 



( 



1 d 3 In Z 
2dh 2 dJ 



1 ,d 3 InZ 



2 y dJ 2 dh 



and 



Id 3 InZ, 



1 ,<9 3 InZ, 



) J 



2„2 



(47) 



(48) 



z v 2dhdJ 2 ' h v 2 V <9J 3 ; J 

What is plotted in Figures [2][4] and Figure [7] is the stan- 
dard error, which is the standard deviation divided by 
V~M, where M is the number of trajectories simulated. 
For each different potential surface, 2200 trajectories 
were simulated, and so M — 2200. 



Appendix II 



Previously in Section IV we saw a systematic underes- 



timation of the measured value of J. To understand this, 
we would like to compare values of J calculated using the 
same constraints (i), (N s ) and same MaxCal model in 
Equation [HJ just with three different types of boundary 
conditions- exact, periodic, and free. Even though we 
cannot analytically evaluate the partition function under 
free boundary conditions, we can still find the value of 
J under free boundary conditions following methods in 
earlier work [5]. Under free boundary conditions, 



P(N S ) = 



N- 1 



(1 



-2JN s 
e -2J)JV-l 



(49) 



Thus, we can evaluate the Lagrange multiplier J as a 
function of the constraint (N s ) using 



JV-l 



(iV s 



N *p( N ° 



(50) 



N s =0 



which, after some straightforward algebra, yields 

J = -\H^1-1). (51) 



To recap, we now have three different values for J de- 
pending on boundary conditions used to evaluate the 
same MaxCal partition function in Equation [8] Under 
periodic boundary conditions, J is found from numeri- 
cally solving the closed form, transcendental system of 
equations given by Equations [9] and [lO] Under exact 
boundary conditions, J is given by Equation |23| U nder 
free boundary conditions, J is given by Equation |51| Our 
goal is to understand whether or not boundary conditions 
is really driving the difference between the three different 
J's by examining how the difference between the different 
J's varies with the constraint (i). 

The average state jl is a sort of metric for how hard 
the particle is pushed to be in one state or the other. Peri- 
odic boundary conditions become more like exact bound- 
ary conditions as the driving force to be in either state 
increases, since then the probability that a trajectory will 
start and end in the same state increases. Free periodic 
boundary conditions become more like exact boundary 
conditions as | | approaches 0, since when neither state 
is preferred, the particle is just as likely to start and 
end in either state. In Figure [HJ as the average state 
approaches 1 and —1, exact and periodic boundary con- 
ditions split away from free periodic boundary condition 
estimates. For (i) close to 0, the three boundary con- 
ditions are very close together. This is what we would 
expect if boundary conditions were indeed driving the 
difference between the different Lagrange multiplier val- 
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FIG. 8: Boundary conditions cause systematic devi- 
ations in evaluations of the Lagrange multiplier J. 

The x-axis shows the absolute value of the average state \ ^-\, 
which is a measure of how biased the particle is towards being 
in either state. The y-axis shows J from: the predicted value 
of J from Equation |23| its calculated value using MaxCal, 
or its calculated value assuming free boundary conditions in 
Equation [5l] The data show that the difference in calculated 
values of J between periodic/exact boundary conditions and 
free boundary conditions increases with the driving force to 
be in a particular state. See text for further explanation. 



